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Abstract 

The push-pull queueing network is a simple two server, two job-stream example in which 
servers either serve jobs from queues or generate new arrivals. Previous work has shown 
that there exist non-idling policies that stabilize the system in the positive recurrent 
sense for all parameter settings in which the network may be rate stable, except for the 
case where processing rates are equal on each job stream (critical). It was conjectured 
in Kopzon, Nazarathy and Weiss (2009) that there is no policy that makes the network 
positive recurrent (stable) in the critical case. Our contribution here is a proof for that 
conjecture. We also consider generalizations where it is shown that a stabilizing non- 
idling policy does not exist in the critical case. In this respect we put forward a general 
sufficient condition for non-stabilizability of queueing networks. 



1. Introduction 

Controlled queueing networks are primary objects of study in operations research and 
applied probability as they provide sensible models for a variety of engineering, commu- 
nications and service situations. Alongside performance analysis and optimal control, 
stability analysis plays a central role in the theory and has far reaching implications in 
the design of systems. A comprehensive introduction to stability properties of controlled 
queueing networks is jlj]. See also j2[ and 

The push-pull queueing network, introduced in 0], is perhaps the simplest example 
of a queueing network that generates its own input and is able in certain cases (described 
below) to operate with servers fully utilized while keeping queues stochastically stable. 
Following jij], the network was analyzed with exponential processing times in |5j and 
general processing times in (fjj. Further network generalizations are in Q. The novelty 
of this network is that by allowing servers to split processing power between "arrival 
generation" and "service of current jobs" , one can often find stabilizing control policies 



1 Research supported in part by NSERC. 



August 30, 2012 



in which servers never idle. This stands in contrast to the majority of queueing network 
models (surveyed in jij and [3}) in which high utilization cannot be achieved without 
having to endure high congestion levels. 
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Figure 1: The push-pull network: Two servers are working non-stop on two job streams, i = 1, 2. Push 
operations, labeled Aj, move jobs to the queues Xi served by pull operations labeled \*i. 



The push-pull network is illustrated in Figure [TJ Two servers are working on two 
job streams. Each job stream begins with a push operation (labeled Aj, % = 1,2) and 
follows with a pull operation (labeled /ij, i = 1,2). The push operation produces jobs, 
serving a virtual unlimited supply of raw materials, and moves them down to the pull 
operation. The pull operation is associated with a queue (labeled Xi, i = 1,2). At any 
state, a scheduling policy (control) determines for each server whether it should work on 
push or pull. Pushing may always be performed as it is assumed that there is an infinite 
supply of raw materials at the start of each stream. As opposed to that, pulling may 
only be performed if the associated queue is non-empty. We are interested in non-idling 
(fully utilizing) policies. 

It is standard to associate the network with a probability space. Specifically, four 
independent i.i.d. sequences of non-negative random variables with positive finite mean 
are taken as primitives of the construction. These random variables signify the durations 
of consecutive operations. The strictly positive parameters Aj and are the processing 
rates of these operations (i.e. inverses of mean durations). A full construction of the 
model is described in 0]. 

In this paper we shall impose a simplifying assumption in which the random variables 
have a memory-less exponential distribution. In this case, if preemption of operations is 
allowed and it is assumed that job durations are not known upon commencement, then 
the state space of the system can be represented by S — Z 2 , , where a state (x 1 ,x 2 ) G S 
implies that there are Xi jobs in the queue i. In our setting, any deterministic and 
non-idling control policy can be represented by a function, 

V : S -> {push, pull} 2 , 

whose image represents the actions of the servers: (action server 1, action server 2). 
Since idling is not an option, the control should satisfy for any integer x > the 
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following conditions 

V((x,0)) e {push} x {push, pull}, V((0,x)) e {push, pull} x {push}. 

Thus it is also implied that P((0,0)) = (push, push). 

Given a policy V, the evolution of the network is well represented by a Markov jump 
process (see for example Chapter II). In this case it is natural to define the following 
stability properties. 

Definition 1.1. A network controlled by a policy V is said to be stable if the associated 
Markov jump process has a positive recurrent class such that the process enters this class 
with probability 1. Further, a given network is said to be stabilizable if there exists a 
policy V for which the network is stable. Otherwise the network is non-stabilizable. 

We emphasize that the above definition relates to policies in which the servers are fully 
utilized. Achieving stability when idling is allowed (no pushing) is trivial. 

In (see also j^j for general processing times), the authors have shown that the 
push-pull network is stabilizable in the case Aj < i — 1, 2 or in the case A« > /ij, 
i — 1,2. Further, it is obvious by capacity considerations that there is no such policy if 
Xi < jtfi, A2 > H21 or m the alternative where the indexes are switched. The remaining 
open question is the critical case, 

Xi = fa, i = 1, 2. 

In that case, while there exist simple rate-stable policies in which the associated Markov 
jump process is null recurrent (see Theorem 1 in \^ and the discussion in Sections 1 
and 2 in |6]), it was conjectured in [|§] (page 83) that the network is non-stabilizable. 
Our key contribution in this note is in settling that conjecture. Our proof is based on 
a simple yet non-trivial martingale stopping argument in which a linear martingale is 
constructed for any possible policy. 

A second contribution of the paper is that we are able to extend the method for 
proving non-stabilizability to more general networks. The novelty of our method is that 
it puts forward a simple matrix rank criterion as a sufficient condition required for a 
network to be non-stabilizable. As we show, this condition turns out to be powerful 
enough to be applied in various types of queueing networks that generate their own 
input. We prove non-stabilizability for two structured generalizations of the push-pull 
network in certain critical cases. First we handle a ring with an even number of push- 
pull servers (Figure [2]). Second we handle a two server network with multiple re-entrant 
lines (Figure [3]). Stable policies have been found for both of these types of models for 
certain non-critical parameter settings in Q. 

The remainder of this paper is structured as follows. In Section 2 we prove that 
the critical push-pull is non-stabilizable. In Section 3 we prove similar results for two 
generalizations: A ring with an even number of critical push-pull servers and a two 
server network with re-entrant lines. Closing comments are in Section 4. 
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2. The Critical Push-Pull is Non-Stabilizable 



Note that a policy V induces a random walk on 1? + with transitions of the form 
(t_^., -^iX ) corresponding to 

((push, push), (pull, pull), (push, pull), (pull, push)). 

This is a discrete time embedded Markov chain, {X n ,n > 0} with transition probabili- 
ties, p^xaUx'xA) = ^{ X n+i = ( x 'i,% 2 ) \X n = (xi,x 2 )) defined as follows: 

P(«i,» a ),(si+i,xa) = x A \ , P{xi,x 2 ),(xi,x 2 +i) — T~TT"' if ^((^1^2)) = (push, push), 

A\ + A2 Ai + A2 
P(*i,«a),(a!i-l,x a ) = -7 , P(m ) « a ),(*i,x 2 -1) = V ' if ^((^l)^)) = (pull, pull), 

A*i + A*i + /^2 

P(*i,* a ),(*i-i,* 2 ) = — TT-, P(*i.a"2),(*i+i,«ii2) = — T~T' if T y ({x 1 ,x 2 )) = (push, pull), 
/il + Ai A*i + Ai 

Pfci.saMxi.aa-l) = tVi P(*i,*»),(*i,*a+1) = if P ((^i , X 2 )) = ( pull , push) . 

A*2 + A2 A*2 + A2 

A given class of {X n } is positive recurrent, if and only if the associated class in the 
Markov jump process is positive recurrent. This holds since all transitions rates in the 
chain are bounded from above by Ai + A 2 + Hi + \i 2 and thus the Markov jump process 
is non-explosive (see for example (of, Theorem 3.5.3). 

In the case where Ai = \i\ = \l 2 — A 2 the process {X n ,n > 0} is a simple symmetric 
random walk on a degenerate (non-random) environment similar to the random walks 
studied in [11 



Theorem 2.1. The critical push-pull network is non-stabilizable. 



Proof Assume that there exists a policy V such that X n has a positive recurrent class, 
B C S. Define, 

g([xi,x 2 )) := Xixt - \ 2 x 2 . 

Under the same probability space, define Z n = g(X n ). It is readily verified by the 
transition probabilities above that E [Z n+ i\a(X , . . . , X n )] = Z n and E [\Z n \] < 00 
hence {Z n } is a martingale (for any choice of V). 

Pick now two arbitrary states x, y G B such that g(x) 7^ o(y). It is obvious that 
two such states exist under the assumption of positive recurrence of B and the form of 
g(-). Set X Q = x w.p. 1 and define the stopping time T = inf{n > : X n = y}. Since 
B is assumed to be positive-recurrent, E [T] < 00. As can be verified with the triangle 
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inequality, \Z n +\ — Z n \ < 1 a.s. and thus, by the optional stopping theorem (see for 
example [11] , Section 10.10), E [Z T ] = E [Z ]. Hence, 



g^) = E[Z ]=E[Z T ]=g(y); 
a contradiction. Hence there cannot exist a positive recurrent class B. 



(1) 
□ 



3. Generalizations 

The key idea of the proof of Theorem 12.11 is to find a function g(-) over S that 
is a martingale (harmonic function) for any possible policy V. The fact that a linear 
harmonic function was successfully employed in the critical push-pull network suggests 
that the method can be generalized to higher dimensional queueing networks. 

In this section we first present general sufficient criteria for non-stabilizability of 
objects that we refer to as homogeneous controlled queueing networks. Then, we employ 
this result to show that two special cases that are structured generalizations of the 
critical push-pull network are non-stabilizable. 

Our object of study is a controlled discrete time Markov chain {X n , n > 0} with 
state space S = Z^ f . Denote by A(z) the set of actions that can be performed from 
any state z G S,. Let A = U z e5^( z ) ^ e ^ ne se ^ °^ an possible actions and assume that 
\A\ = L < oo. A deterministic policy is then a function, V : S — > A, with the restriction 
Viz) G A(z). It is assumed that under such policies X n G S for all n. Transition 
probabilities depend on the selected action a G A(z) and are assumed to be specified by 

^a(X n +l = ■ | X n = z) . 

These objects are termed homogenous since we assume that, 

P (x) := P a (X +1 - z = x| X n = z), 

is independent of z. Further they resemble queueing networks due to the transition 
structure that we describe now. Let {e^f^ denote the canonical row vectors in IR M and 
define the set of possible transitions, 

D:={xG R M : P„(x) > for some a G A}. 

We assume elements of T> are of one of these three forms: ej, — ej or — ej for % ^ j. It 
is further useful to define 

Xi := {i : ej G V or -e 8 G V}, 1 2 := : e^ - ej G V}. 

Elements of Ii correspond to arrivals or departures of jobs into the network. Elements 
of X2 correspond to movements of jobs between queues in the network. 

Our goal is to establish non-stabilizability in certain parameter cases. Similar to 
Definition 11.11 we say that these more general networks are non-stabilizable if there 
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does not exist a policy V that induces a positive recurrent class that is reached w.p. 
1. Mirroring Theorem I2.1[ our key step used to prove non-stabilizability is to find a 
function g : S — > M that is harmonic for all policies. The function g should satisfy 

E a [g{X n+1 ) - g(X n ) \X n = z} = 0, z G S, a G A(z). (2) 

The appeal of being homogenous and having a finite action space A = {ax, . . . , a^} is 
that the number of these equations reduces to L: 

E at [g(X n+1 ) - g{X n ) | X n ] = 0, i — 1, . . . , L. 

It is now sensible to restrict the search of harmonic functions to the class of linear 
functions, g(z) = a'z with ex. G M M and ol ^ 0. In this case, proving that g is harmonic 
reduces to finding ol ^ such that, 

a'Ai = 0, i = l,...,L, (3) 

where Aj := E ai [X n+ i — X n | X n ] is the drift vector of action a^. We define the L x M 
dimensional action drift matrix D as having rows A-, i = 1,...,L. Therefore ([3]) 
becomes 

Da = 0. (4) 

We are now in a position to state a sufficient condition for non-stabilizability: 

Theorem 3.1. Consider a homogeneous controlled queueing network {X n , n > 0} 
with action drift matrix D. Then it is non-stabilizable if 

rank(D) < M, (5) 

and the following non- degeneracy condition holds: The system (j3J) has a solution ol such 
that for every x G S and every a G ^4(x), ¥ a {ot'Xi ^ a'x | Xq = x) > 0. 

Proof The proof follows the exact same lines as the proof of Theorem 12. 1[ The rank 
condition implies that (jl]) has a non-trivial solution a, so there exists a non-trivial linear 
function g(-) that is harmonic for all policies. The non-degeneracy condition implies that 
for every x G S there exists a state y G S which is reachable from x and is such that 
g(x) 7^ g(y)- Hence, if it is assumed that there exists a positive recurrent class B, then a 
contradiction as in ([T]) can be reached. The additional condition needed for the optional 
stopping theorem requiring that \Z n+ i — Z n \ be bounded is guaranteed by the form of T>. 
□ 

Observe that the technical non-degeneracy condition actually implies ([5]) , yet we view 
the rank condition ([5]) as the central pillar for establishing non-stabilizability. The lemma 
below puts forward sufficient conditions for satisfying the non-degeneracy condition: 
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Lemma 3.2. Consider a homogeneous controlled queueing network for which there ex- 
ists an a 7^ solving (j3j). If for every i G X 1} a>i 7^ and for every G X 2 , a, 7^ CKj 
then the non- degeneracy condition holds. 

Proof For every initial condition X and every action in A(X ), almost surely one 
of these two events takes place: (1) A single coordinate, i* G X\ changes. (2) Two 
coordinates, denoted G X 2 change. If (1) occurs then \a'(Xi — Xq)\ = \ai*\ 7^ 0. 

If (2) occurs then ot'{X\ — Xq) = ai* — aj* 7^ 0. So in any case, tx'X\ 7^ ol'Xq a.s. □ 

3.1. A Push-Pull Ring with an Even Number of Servers 




Figure 2: A Ring of M — 4 Push-Pull servers. 



One way of generalizing the push-pull network is to allow more servers as in Figure |2j 
In this network there are M > 2 servers with the same number of streams. Each stream 
has a push operation at rate Aj and a pull operation at rate /ij. Our index notation 
implies that server i has a choice between push to stream i (at rate Aj) or pull from 
stream i — 1 (at rate All index arithmetics are modulo M on {1, ... , M}. 

Similar to the push-pull network (the special case with M = 2), a non-idling policy 
is a mapping V : S — > {push, pull} M , with the restriction that the pull operation i (on 
server i + 1) can only be performed if Xi > 0. 

Stability properties of this model under a "pull-priority" policy (and general pro- 
cessing times) were investigated in Section 5. In there it is shown that the network 
is stable if Aj < fa, i — 1, . . . , M as well as if M is odd and Aj > fa, i — 1, . . . , M, yet 
the ratio Xi/ fa is "not too large" (see [7f for the full details). We further believe that 
for odd M, the network is stabilizable in the critical case (Aj = fa for all i) by means 
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of a pull-priority policy. This has not been established in [7J, yet stems from the same 
intuition appearing in [3] based on the concept of a mode. 

An interesting aspect of push-pull network rings is that even rings (network rings 
with an even number of servers M) are drastically different to odd rings. For example, 
the pull-priority policy cannot be stablilized for even rings in which Aj > [ii for all v. To 
see this, assume the state of the system is, 

(xi,x 2 , ■ ■ ■ , x n ) = (+, 0, +, 0, . . . , +, 0) , 

where '+' indicates a strictly positive quantity. Then, the selected action under pull- 
priority is 

(push, pull, push, pull, . . . , push, pull) . 

In this case there is a strictly positive probability that the '+' queues will grow without 
bound. The drastic differences between even and odd rings go beyond the pull-priority 
policy of Q. We now show: 

Theorem 3.3. The critical push-pull ring with M even is non-stabilizable. 

Proof The push-pull ring, described as a homogeneous controlled random walk, has 
action drift matrix D of dimension 2 M x M, X\ = {1, . . . , M} and X2 = 0. We apply 
Theorem 13.11 and Lemma 13.21 The rank and non- degeneracy conditions are ensured by 
the ex. found in Lemma [3.41 below. □ 

Lemma 3.4. In the critical case 

M if M is odd, 
M — 1 if M is even. 

Further, when M is even a solution of (j4j) is 

a = ( 4-A^ 1 -A 2 1 +A 3 1 -AJ 

Proof 

Define (3j := Xj — fij, j = 1, . . . , M and for a given action i 6 {1, . . . , 2 M } let be 
the sum of rates associated with the action. Then Aj has entries that depend on the 
action i as follows: 



Operation on: 




Server j — 1 Server j 


Entry j 


push push 




push pull 


Pi 


pull push 





pull pull 


-flj 




+A 



-1 

M-l 



-Am 1 )'- 
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This, in turn, implies the following relation between consecutive entries: 



Entry j 


Entry j + 1 


\ = 


X j+1 or (3 j+1 


-fij = 


> —Hj+i or 





> (3 j+1 or Aj+i 


Pi = 


> or —fJ.j+i 



Define the matrix, D = sign(D), where the function sign(-) is taken element-wise. In 
the critical case (/% = 0, % = 1, . . . , M) it is evident that rank(D) = rank(D) since 
Djj = t>ij\j/rj. Further, by considering the structure of consecutive entries in the 
table above, it is evident that in each row of D: 

(i) The number of 0's separating two non-zero entries with the opposite sign is odd. 

(ii) The number of 0's separating two non-zero entries with the same sign is even. 

A consequence of (i) and (ii) is that the number of zero entries in each row of D is even 
since there is an even number of 0-sequences that have an odd number of zeros. Hence 
in an odd/even ring there is an odd/even number of non-zero entries. 
M odd case: 

Observe each of the vectors in {e^ : % — 1, . . . , M} is also a row of D and therefore it 
has full rank. 

M even case: 

First, we prove that rank(D) > M — 1. Second, we show DA = 0, where, 

a=( +1 -1 +1 -1 ... +1 -1 )', 

this immediately implies that Da = 0. 

Consider the vectors U — + e i+ i, % = 1, . . . , M — 1, observing these are rows of 
D. Next, define B to be the matrix of size (M — 1) x M with i'th row fj. Let B_i be 
a square matrix of size (M — 1) x (M — 1) obtained by deleting the first column of B. 
Clearly, B_x has full rank (the determinant of a lower triangular matrix is the product 
of its diagonal elements). Hence rank(D) > M — 1. 

To show rank(D) < M we show that A a = for any row A = (Si, . . . , 8m)' of the 
matrix D. 

Let ik be the index of the k-th non-zero entry of A starting from index 1, and m its 
total number of non-zero entries. Since m is even, then we can write 

m m/2 
i 

k=l k=l 
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Define £k '■— 12k — *2fe-i — 1 the number of zeros between the non zero consecutive entries 
5j 2fc _ 1 and 5j 2fc . By the definition of A and ex. there are only two possibilities 



odd =^ 5i 2k _ x = -5 i2k and = a i2k , 



even 5 i2fc _ 1 = 5 i2k and a i2fc _ 1 = -a i2k . 



This implies that 

^fc-i^-i + K k & i2 k = °> fc = 1, . . . , m/2, 
proving that ck is a solution of Da = 0. □ 



Server 1 Server 2 




Figure 3: A network of re-entrant lines on two servers. In this example S — 2, n\ — 3 and ri2 = 4. 
Hence the number of buffers is M = 7. Further the number of actions that a control policy may choose 
is L = 20. 



Re-entrant Lines on Two Servers 

We now consider a network as that appearing in Figure [3] essentially generalizing the 
push-pull by allowing streams of more than two steps that may re-enter servers multiple 
times. Denote the number of streams by S > 1. Each stream % e {1, . . . , S}, has + 1 
operations labeled by (z,0), . . . , (i,rii), where the operation (i,0) is associated with an 
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infinite supply of materials and the other operations are associated with queues. Assume 
rij > 1. Hence the number of queues in the system is, 

s 

i=i 

and the total number of operations is M + S. As in the push-pull network there are two 
servers, labeled 1 and 2. Each operation is performed by a unique server denoted 
cr(i,j) G {1,2}. A control policy is then a rule based on the number of jobs in each of 
the queues, indicating for each server what operation it needs to work on. 

The processing rate of operation is denoted by /ijj > 0. It is useful to denote, 
for each stream, i G {1, . . . , S}, the set of operations on server £ G {1, 2} by, 

C t (i):={je{0,...,m} : a{i,j)=£}. 
Motivated by [3J, Section 4, we say that the network is critical if: 

E Hv= E i = l,.-.,5. (6) 

ieCi(i) ieC 2 (i) 

This means that for any job, the mean processing duration of service required by the 
job on each of the servers is equal. 

The case of S — 1 is typically called the re-entrant line (with infinite supply). It was 
analyzed in Q, Section 3 under a last buffer first serve policy. The case of S = 2 is a 
direct generalization of the push-pull network. It was analyzed in Q, Section 4 under a 
specific priority policy. 

For notational purpuses, it is useful to order the M queues using some arbitrary per- 
mutation of the set {1, . . . , M}. Denote k(i,j) to be the queue served by operation 
i G {1,...,S}, j G {l,...,rij} (note that operations (i, 0) do not have an associated 
queue). Further denote i(k) and j(k) as the inverse mappings, i.e., k(i(k),j(k)) = k. 

Similar to the push-pull ring of the previous sub-section, it is straightforward to 
model this network as a controlled random walk. In doing so, it is useful to partition 
the set Xi into X 1+ , the queues fed by push operations at start of each stream and Zj. ( _, 
the queues drained by pull operations at the end of each stream. Further, the set X 2 
is associated with operations that are neither at the start or the end of the stream, 
involving movement of jobs between buffers without changing the total number of jobs 
in the system. We now have, 

X li+ = {ke{l,...,M} : j{k) = l}, 
X r ,_ = {ke{l,...,M} : j{k) = n m }, 

X 2 = {(k,k')E{l,...,M} 2 : i(k) = i(k'),j(k)=j(k')-l}. 
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Denote Li = ^2 i=1 \Ce(i)\ for £ = 1,2. Then the total number of actions is L = L\ L 2 
and the action drift matrix D is of dimension L x M as is consistent with previous 
notation. Denote for each operation and each k G {1, . . . , M}: 



3 = 0, 



// i)0 k = k(i, 1), 
otherwise, 

-/ijj = k(i, j), 
Hij k = k{i,j + l), j G {!,. . . ,n { - 1}, 







otherwise, 



fl>i,m k — k(i, Hi), 

otherwise, 



71,;. 



Let A(i, j) G M M be the vector of these elements. Now each row of D corresponds 
to two actions, such that cr(«i, ji) = 1 and (i 2 ,j 2 ) such that <r(i 2 ,j 2 ) = 2. We 

denote this row by A(ii, j±, i 2 , j 2 )' with, 



\A(i 1 ,j 1 ) + A(i 2 ,j 2 )\\ 1 



[A(i 1 ,j 1 ) + A(i 2 ,j 2 )). 



Having defined the controlled random walk we are now ready to prove that it is non- 
stabalizable. 

Theorem 3.5. The critical network is non-stabilizable. 

Proof We find an a 6 R M such that Da = 0. The elements of a are, 



For any % G {1, . . . , S}, it is straightforward to verify that if j = 0, 

A(i, j)'a = ^,0 — (-1)^) = (-1)*<«>. 



Further, if j G {1, . . . , rii — 1} then, 



A(ijy a = J_ ( _i r w) + ^.^; J_ ( _i r w) = ( _i)*<«>. 



J'=0 
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Further if j = rij, 

A(i,j)'a = — (-l)^' 



> ;'cn,w o'er 1 , m ' 



•i'eC 2 (i) i'eCi(i) 

In the last equality we use the fact that the network is critical, Hence for any (i, j), 

A(i,j)'a=(-l)*W>. 

Now for any row of D, i.e. for any («2, J2) such that cr(ii,ji) = 1, cr(i2, 32) = 2 

we have that, 

a'Aih^^h) = 1 ((-i)^iJi) + = 0, 

||A(zi,Jl) + A(« 2) j2)||l 

as needed. Since a ^ 0, the rank condition of Theorem 13. II holds. 

To see that the non- degeneracy condition is satisfied, we use Lemma [3.21 First, for 
every k £ X 1+ , it is evident that a k 7^ . Further, for every k £ denote i = i(k), 
then 

n»— 1 

«* = E^- 1 )*^ = E E ^-^(-^Vo, 

i=o ieC 2 (i) jeCi(i) 

where the last inequality follows from the fact the network is critical. Finally, for every 
pair (k, k') £ X 2 we verify 

a k> -a k = _J_(-1)«*(*)J(*)) ^ 0, 

A*i(jfc)j(fe) 

as required. □ 



4. Closing Comments 

The interest in non-stabilizability of the fully-utilizing critical push-pull network 
stems from the fact that in symmetric non-critical cases it can be stabilized. This is 
true for both A < fi and A > fi in contrast to traditional queueing networks. Hence our 
contribution that the network is non-stabilizable for A = \i is of interest. 

The consequences to more general networks as appearing in Section 3 are interesting 
in their own right, since Theorem 13.11 provides a general sufficient condition for non- 
stabilizability of quite general models. 
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It should be noted that the class of policies, {V}, we consider is that of stationary 
deterministic policies. One can also consider randomized policies where an action a G A 
is taken with a given probability. Extending the non-stabilizability results to this case 
is straightforward and carries no surprise. Further, using continuous time martingales, 
it is merely technical matter to extend to non- stationary policies. 

As opposed to non-deterministic and/or non- stationary policies, a non-trivial exten- 
sion is to consider networks with general processing times (not necessarily exponentially 
distributed). In this case one way of providing a Markovian description to a network is 
based on residual service times (see for example and references there-in). In that case, 
we conjecture that the non-stabilizability results of this paper carry over, yet proving 
such results may require a different set of tools than the one we have used here. 
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